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ABSTRACT . 

. ; A study to determine whether college 'students in 

fxrst-, second-, and third'-year Spanish cojirses who saw and heard 
dialogs between native speakers would score\significantly higher on a 
listening coropr)Bhen|i on test than those wlip^only heard the dialogs 
hadvas its subjects 178 student^ randomly divided into two treatment 
groups. Twenty-seven dii&logs, each containing items of varying 
degrees of difficulty and- each le^s thap one minute long, were 
videotaped for one group and the Soundtrack was dubbed onto audiotape 
for the other group. The comprehension test consisted of 60 
multiple-choice completion items in English^. The statistically 
analyzed results / indicated that students in the first- and 
second-year courses who saw the videotapes performed signif leantly 
better than those hearing the audio portion only. It is theorized 
that this occurred because thie videotape provided more stimuli 
contributing to redundancy. Followup interviews indicated that 
^students seeing the videotape may have had more interest and greater^, 
motivation to pay attention thjin those hearing the sound only. The 
test's ability to discHminate was about equal for audio- and. 
videotapes, but teachers are cautioned to use discrimination indices 
only whe¥ using tests tfe rank- students rather than when assessing 
progre.ss. It is also suggested that if students do understand more of 
the videotaped version, they will f eel ^greater success and incen'tive 
for developing their language -skills. (IfSE) 
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VIDEOTAPE VS. AUDIOTAPE FOR LISTENING COMPREHENSION TESTS ' i 
* . ' AN EXPERIMENT 

•. 

O \ - Thomas S. Parry, The Ohio State University 

, Meredith, Brigham Young University 



ir% «^,oi»o^f!^w^^ ,1"*.^"^/°" °^ foreign language teachers turns to 

Z lTJ^TrSL^^^^^^^ it is not unconmion 

CV _ ta assume that a standard format will be used, for the test. This 

/ tormat almost always consists of .spoken material plaved two or 
i5 u^^' *^ audiotape recorder. The t^pe may be heard 
through headsets, as in the learning resource center; or through 
a^loudspejkei*^ as in t^e classroom. The students generally have 
to respond to a series of questions of the type used in objective 
^ests such as!.muljiple-choice, true/false, and » so on. While the 
o^S^^'kI "if^^ ^ the listening tests may vary somewhat in content 
and objective, most^listentng comprehension tests have .one contaion 
characteristic I ^ the speaker is heard but never seen by the* stu^ 
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^ ^Ducroqiaet (X) claims that listening comprehension tests "at- 
It^ll f?4 ^^^^^f i% "J^^^ subject listens iii a foreign language, 
where 'listen V Ij-taken literally and means strictly listeriT and 
is^^only the result of hearing" (2). This attitude of "listen on- 
iLi^^^^rHJ'i^^/^^l^^??^ In reference to the few occasions in 
I t4 5® ^"^^^^^^^^^"8 aipne. Such situations exist when 

one listens to. a jadio broadcast or a record, When talking on the 
telephone, or wheti listening to a conversation behind a closed 



' ^^^^f!?^^^ foreign language- edtiaator 

transmits ^onverb^l aues. . Not only are these cues available in 
most face^to-face conversations, but they are also present during 
y the teacher-learner dialogue. Since one of the goals of second- 

language Jearpers Is to coiimiunicate In the real world using their 
npwly ^ acquired skills, foreign language teachers constantly 
strive to build "reAl world" environment into their programs . 

' ' ^^^^.^^^u^^*"'^^^ is ' built into, the teaching situations has S 

. jecessarlly become ai? important aspect of testing programs. Since 
there Is such a gre^t deal of information tralismitted nonver^ly 

XT . . a^J^i^g reai^iife conversations, , it seems logical tp predict that 

^ ^ adjunct to tests of listening comprehension ability 

. would increase Jthe comprehensibility of aural material. With that 

^ . increase ^ in odmprehensibility, - the instruments should provide 

' °^^f i^^ial^le ^measures of student ability to comprehend natural 
.•4 spoken speech. 



. ^"/t^ermore, when one considers the fact that research into 
cne role of nonverbal cues in the total commimicatlon process 
suggests that no full comprehension of oral li)mmunication is 
complete without consideration of the nonverbal cues, it seems 
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I!efL"'^!,t^l^'^^^^^^^°.P'^^^'^^ ^« listening coniprehensiori 

to ?h/i;f«nfnr'/^i;' <^^^^i^Bln^ completely a whole host of clues 
that "Xt^^ it f W T^^^^^t, transmitted . Jarvis ,( 3 ) nrntntained 

^ certain lack of realism inherentH'ln prfesenting 
listening items wihout a visual dimension" (4). He further 
stressed that hearing spoken language , isolated from all other 
f^^'^l^'^^^ ^PP^^"^ exercise rather than as a sim- 

ulation of a coiranunicative situation which it is believed to be 
by^many educators- (5)..Rivers (6) , on the other hand, though n^t 

''^^ visual cifes in listening comp?eh<^n-. 
tt^^ Ik ^ t-eliance on a visual r^presentatijjn might ralan 

that the student comprehends less well when left to depend on the 
ItlhliT.;.^ Speoif ically^regarding the testing of lls^Slng "com' 
prehension: with a visual dimension, she felt that it might prove 
nrlL^H^f detetlnine whether the student hac^ actuiUy^com! 

prehended the aural message or deduced it from the visual stimu-. 
ius Jaryis (8) however, pointed out that "rather than pro- 

^i^ie^.Tfl^^^^^''^ clues, as some may claim, the visual restores 
tests" ^""^^ unnaturally deleted in feorae pure^ audi tory 

* ■ ■■ ■ . ■ ■ '. 

^inr. If Hi"^^ Videotape to restore the visual adjunct, tji^fjtnclu- 
add to rhf ''l^ ^Vil^ expressions,- and body' language ^thould 

V™ ^"""^^ stimuli, Goncernini the use of 

Xo^fS tC^*. ?r comprehension testii, Stallings (10) indi- 

cated that "one would expect that the presentation of a foreign • 
language listening test would be more verisimilar <and involve 
audiotapl" UIK ^ ^presentation of the same material by 

Related Research , ' ■/ ' ^' 

utI conducted an experlement in which Form FB of the 

A *^f;!"c]^ listening Examination was administered via audiotape 
^JlfiL'^r^^P^ as part ^ of the final examination for students eS! 
^ndu^riS ^^^°J}f-ye«^ f oil^Se French courses. The experiment was 
conducted at ^the conclusion of both the first and second semes^ 
rfff?:^*.^ neither occasion was there a statistically significant 
difference between the scores of the students tested by audiotape 
and^those. tested by videotape. It must be noted, however, that 
problems were encountered during the study that affected control 
over certain aspects of the study and threaten the internal val- 
idity of the experiment (12);. , 

4 * r^^I^^^?* Jackson (13) designed an experiment to deter- 

mine the effect of videotaped versus audiotaped interviews on the 
listening comprehension of foreign language students. He too fo- 
T sjy^ents enrolled ti? beginn^ing college French courses. 
Jackson s hypothesis wa^ that students who viewed ,a videotape 
would score significantly higher on a -test of comprehension of 
the' Interviews than those who listened to the audio track of the 
same interviews. While problems, regarding the test reHabillty 
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hampered an earlier experiment, the results of a second "experi^ 
roent supported his hypotheses. ^ 

^K.- findings irom Jackson/s research, together with those 

obtained from the^study discus^d in the following sections, pro^ 
f^^^ evidence that the inclusj.on of a videotape adjunct 
u ^ffJf"i"8con»P^ehension tests does indeed increase thecompre- 
hensibility of aural stimuli in a foreign language. 

yhe Present Study 

^ ^ The presertt study was desigited " to determine whether colleee 
students tn fii^st--, second- , and third-year Spanish courses who 
saw and heard dialogs between n&t|.ve speakers of the languaee 
would^score significantly higher on a test of their comprehenslSp 
ot material presented in the dialogs than students who listened 
only to the audio portion of the conversations. 

' - , • • • 

The experiment was designed to treat each course level as a 
separate, independent experiment from the other levels, each with 
separate data analysis and interpretation.. The subjects for each 
level wer6 randomly divided into two sub-groups of equal size, 
tach sub-group was then randomly assigned to receive either the 
.videotape or the audiotape treatment. , / 

■ •, ' > ^ - . 

A total of 178 itudents enrolled in the first three years of 
college Spanish participated ia the experiment. Four levels were 
actually involved since the first-year course is divided into two 
^^iS^S^ ''''ir^^/ a.e. first-semester. Beginning I, and s^^cond- 
f ri Beginning II ). while the second ( Intermediate) and 
ttiird (Advanced) years are one-semester courses. Even thoueh the 
experiment took place outside of class, all students In each of 
tHe courses^ participated as a natural consequence of %elng en- 
rolled in their respective courses. Volunteer! 6m, therefore, did 
not play. a part in* the study, * ' 

* , ■ 

^Twehty-seven dialogs portraying native Spanish speakers en- 
gaged in cononon, everyday activities and conversations were de- 
veloped. The dialog situations were designed to be relevant to * 

uf u "^,f^^®^®. students and to represent situations in 

?K '^^^^^^ ^^"^^^v^^ly themselves.-/ Because 

the dialogs would be seen and/or heard by students at different 
stages of Instruction and of differing levels of experience' In 
the language, ^^an attempt was made to Include items of varyine 
degrees of difficulty corresponding to each of the first three 
years of language ^tudy. In order t6 reduce, the importance of 
memory during the administration of the test, none of the dialogs 
f^f V 1 o^e^niinute in duration, the shortest being approximately 
twenty seconds in length (14). The dialogs were videotaped and 
then the audio track; was electronically dUb|)ed onto audiotape in 
order^. to ensure that the sound tracks be identical. 



1^. i*® Ustening comprehension test itself consisted of sixty 
multiple-choice items of the completion type, based on inforraa-- 
tion contained in the taped dialogs. Although many listening 
tests jequire students to listen to taped dialogs and then answer 

^est items written in the target language, the present study used 
test items written in English. This was done to avoid the simul- 

-taneous testing of the reading skill in the foreign language. 
Items were written to focus" on the general content of the conver- 
sations rather than on details which would test memory instead of 
communicative comprehension. ' The test item stems were recorded 
on the tapes following the corresponding dialogs. This was done 
in an attempt ^to^prevent subjects from obtaining advance clues to 
the content of the tapes and subsequently listening for specific 
bits of information rather than focusing attention on the entire 
dialog. The possible responses were printed in the test booklet. 

it.uJ^t Kuder-Rlchardson formula 20 was used to assess^the re- 
,7 ^ measurements. The reliability coefficients for 

the listening comprehension test for each course level and treat- 
ment group are pi;es^nted in Table 1. 



TABLEJ,. Reliability Coefficients for Listening Comprehension 

Test by Course Level ♦and Treatment Group 

Level : Beginning I Beginning II Intermediate Adva*nced 

Audiotape: .943 .785 • ,839 .099* 

Videotape: ..832 .932 ^ '314*. 

*A11 students in the Advanced group had neaJRrfect scores, thus 
eliminating variability among scores and resulting in poor relia- 
bility coefficients. , 



^ , Two viewing rooms with seating capacity of forty persons 
each were used for the listening test administration. One of the 
rooms was equipped with a Video cassette player and two wall- 
mounted television monitors. -The other room was outfitted with a 
reel-to-reel audiotape player. (Reel-to-reel equipment was used 
in the audio^only treatment due tx^ the higher quality sound re- 
production it offers over typical audio cassette equipment.) The 
test was administered, to, all groups following identical proce- 
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The scores from each of the treatment groups were analyzed 
T^i?^ .Results of those analyses are summarized in 

5.ir ^" ^^^^ table, results of the t-test tfor 

the difference between means of the Beginning I groups" showed a 



TABLE 2. 



'Descriptive D^ta and tllest Results for Listening 
Comprehension T^st Scdi-es i^^i^i-ening 



Level 


Treatment 


n 


Mean 


SD 




Beginnihg I 

• 


Audio / 
Video ' 


25 
25 


21.12 
30.80 , 


11.45 

7.52 


3.53* 


Beginning II 


Audio 
Video 


15 
15 


24.80 
35.07 


6.13 • 
11.76 


3.00* 


Intermediate 


Audio 
Video 


42 


32.91 
38.40 


7.26 
7.31 


3.41* 


Advanced 

♦ 

• 


Audio 
Video 


7 
7 


40.14 ■ 
39. 5>^ 


1.13 
1.59 





* p < .01 • . ' 

** relTaM?l^^of''^^*°f?^^ data' due to the poor 

reliability of the listening test with these students. 



Significant difference [t (48) = 3.53, p < .001 ] f avortne the vld 

"^he audiltlpe groups « = a 12)' 

cant di«e?enc\^^t%)''"3"||'""'"« o!l '^"^'^' '^ 

Differences between the treatment group mear^s for the Interiiedi 
ate level students were also statistically significant I t (Sof I 
lut ' A? S'^^^ favoriiig the videotape subjects (X 38 ^0) over 
the audiotape subjects (X = 32.91*). jo.^uj over 

AA t-test was not performed for the data obtained from th^ 

Advanced groups since an item analysis revealed no discrimin^tfn^ 
tSl Set ^t^ar \L'T. -,^1^/^^^ity Leffici'entf Tlfi'/l^as d^e'^o 
students most o^ Jho.^^^^^^^ test was too easy for the Advanced 
cmintrv and rhf;.?^^^ ^P^uf ^""^ ^^^^^ ^" a, Spanlsh^speaking 
yo^t ry and, therefore, were able to answer almost all questions 
64jB^ctly regardless of the treatment level. quescions 

Summary and Discussion . ^ 

the hypothesif1:h«t V^h/ ^"^"^ « P^^^^l °f 

cue ijypocnesis that the inclusion of a visual adiunrt ^n 

tenlng comprehension tests would allow studentl^o seethe tota?" 
Ity of natural communication hetweeh nativrsLnish Leakers 
eluding verbal and nonverbal cues (facial expreSilL^ han^i^er 
tures and body movements) and consequenay allow them to sfore 

ffiSr^'of^'^H^^ °" a.test of.fisteJng comprehens on tSIn • 
students of equal language proficiency who receive the verbal 
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cues only. It would appear from the data presented^ in Table 2 
that the visual stimuli of the dialogs, r'e stored by the videotape 
procedute-, made a slgnificajit contribution to the comprehension 
for students in "the Beginning I, Beginning II and Intermediate 
levels. It can be theorized that such results werfe obtained be- 
cause the videotape presentation contained a greater quantity of 
. stimuli contributing to tW5 redundancy of the language, thereby 
making it easier for the students to understand. The subjects in 
the videotape groups actually had more stimuli with "which to in-- 
terpret the message being conveyed, helpinfcf It to appear more 
like real conversation. . * 

Follow-up interviews held with some, of tHe participating 
students incUcated that there may have been a ' higher interest 
level and greater motivation to pay attention among students re- 
ceiving the videotape presentation. This may have resulted in 
increased involvement with the subject matter, simply because 
th^y could see a television picture. This would suppport the 
view that one w<^uld expect the presentation of foreign language 
listening testfe by . videotpae to be more verisimilar and to ^ in- 
volve the students more thaiii the presentation of the same mate- 
. rial by audio-tape., 

V ' ■ I ^ - .' ° ■ . 

A care j^ul examination of the instrimfent's reliability coef- 
ficients presented in Table 1 will reveal that the "test discrimi- 
nated equally well for both audio and video modes of presenta- 
tion. Thus it could -fee argued by some that foreign language 
teachers should not ' have * to go to the added expense ^and trouble 
to provide the visual adjunct when an audio versipn of ^^he test 
will discriminate -equally well. One must be careful to etisure, 
when concerned solely with discrimination indices in testing, 
that the intent is merely to rank students rather than assess 
their progress in skill development. Also, it must be reempha- 
sized that with the exception of listening to the radio or talk- 
ing on the telephone i there are few real-life communication situ- 
ations in which the listene»r is unable 'to see the speaker. For 
this reason,, most ^audiotape presentations introduce a greater de- 
gree -of artificiality for second language learners because they 
cannot see the totality of cues that provide for complete under- 
standing. Hence on tests of listening comprehenison, audiotape 
presentations would provide an erroneous measure of what the stu- 
dent might have understood in a real-life situation.^ If the goal 
of foreign language instruction is to develop as much as possible 
a real-life communicative ability in each student, then there is 
plausible evidence to argue in favor of the visual adjunct to 
llsteninjg comprehension tests. 

' . . . ' „ ' ' \ ' / • . ' - ' 

If it fs true, as it appears to be, that students do under- 
stand more of the conversation when presented via videotape than 
by audiotape, then an\ added bonus will be that the students will, 
feel a greater degree \ of success in learning a foreign language' 
and an increased desire to further develop their capacity to un- 
derstand conversational\ speech. 
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dr^?f fo^^^^J recording; ^ the dialogs were^ Written in rough 
draft form and then revised by two native Spanish- sneakers to 
^ "^^"J^j-fo^nding conversation. The conversations 
were then enacted in a natural way (without the scripts beine 
memorized), ^nd audiotaped. Next, a written transcript of the 
conversations was prepared from the audiotape and was used 
for rehearsing the dialogs. The "actors" were instructed not 
to memorize the scripts, but instead to use t?hem merely as a 
fViu ^^f ensure spontaneity of natural speech 

with its concomitant hems, haws, gestures and facial expres- 
s X ons * . 



